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The  ability  of  AUTO  to  monitor  rapidly  changing  weather  events  and  to 
discriminate  different  types  of  weather  is  demonstrated  through  selected 
hourly  periods  of  observations  taken  at  1-min  intervals. 

Hourly  observations  generated  over  a  14-month  period,  March  1978 
through  April  1979,  are  compared  with  FAA  observations  to  determine  the 
effectiveness  of  AUTO.  Major  areas  of  agreement  were  found  in  the 
discrimination  of  fog,  haze,  snow,  rain,  and  no  weather.  Final  results  show 
that  the  FA  A  observations  of  the  existence  and  non-existence  of  obstructions 
to  vision  a.id  present  weather  were  duplicated  in  82  and  86%  of  the  cases. 
Thus  the  acquisition  of  real  weather  for  an  aviation  weather  observation,  a 
duty  presently  performed  by  a  human  observer,  is  obtainable  through  an 
objective  decision -tree  program  using  an  automated  sensor  array. 
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Automation  of  Visual  Weather  Observations 


l.  INTRODUCTION 

The  need  for  automatic  surface  meteorological  observing  systems  has  been  well 

1  2  3 

established  for  many  years.  Acquisition  of  data  from  remote  locations,  ’  re¬ 
lieving  the  human  observer  of  the  necessity  of  constantly  monitoring  rapidly  changing 
4 

weather  events,  and  the  ability  to  perform  numerous  routine  operations  continu- 

5 

ously  are  but  a  few  of  the  reasons. 

In  response  to  Air  Force  requirements,  a  project  was  begun  in  January  1976  to 
develop  a  low-cost,  fully-automated  system,  modular  in  design,  which  would  also 
be  simple  to  maintain.  One  phase  of  the  project  was  the  installation  of  a  prototype 
Modular  Automated  Weather  System  (MAWS)  at  Scott  AFB,  Illinois  to  demonstrate 
the  versatility  of  the  system.  Briefly  summarized,  weather  instruments  at  three 
runway  sites  and  a  tower  were  polled  several  times  each  minute,  voltages  were 
converted  to  meteorological  values  and  transmitted  and  displayed  at  four  locations 
on  the  base.  Variables  observed  included  wind,  temperature,  dewpoint,  visibility, 
pressure,  and  cloud-base  height.  In  addition,  short  range  forecasts  of  visibility  and 

cloud-base  height  were  generated  and  several  critical  weather  criteria,  for  example, 

6  7 

wind  chill  temperatures  and  runway  cross  winds,  were  monitored.  ' 


(Received  for  publication  2 i  March  1980.) 

(Due  to  the  large  number  of  references  cited  above,  they  will  not  be  listed  here. 
See  References,  page  33.  ) 
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The  variables  measured  in  MAWS  almost  constitute  a  a  complete  aviation 
weather  observation.  However,  the  prevailing  visibility  reported  was  derived  from 
a  single  sensor,  which  is  only  an  approximation  to  the  prevailing  visibility  that  the 
human  observer  is  required  to  take.  The  cloud- base  height  was  also  a  substitute 
for  the  ceiling  observation  that  is  required,  and  sky  conditions  were  not  observed 
at  all.  The  final  items  missing  from  the  MAWS  automated  weather  observation 
were  the  weather  and  obstructions  to  vision. 

The  weather  and  obstructions  to  vision  elements  are  those  atmospheric  pheno¬ 
mena  which  are  classified  as  hydrometeors  and  lithometeors,  that  is,  liquid  or 
solid  water  particles  and  mostly  solid  dry  particles  suspended  or  falling  through 
the  atmosphere.  Since  the  inception  of  weather  observations,  human  observers  have 
been  required  to  determine  these  elements  visually. 

Several  methods,  utilizing  different  instruments  and  techniques,  are  currently 
under  consideration  for  the  automation  of  the  two  preceding  elements.  Moroz 
noted  that  the  rotating-beam  and  the  lidar  ceilometer  provide  distinctive  returns 
during  rain,  snow,  and  fog. 

Interest  has  also  been  evidenced  recently  in  the  possibility  of  identifying  several 

classes  of  weather  through  the  observation  of  scintillation  and  forward  scatter  of  a 

9  10 

laser  beam.  Recent  publications  '  described  the  efforts  to  differentiate  clear 
air,  rain,  snow,  fog,  and  drizzle  with  a  prototype  laser  instrument.  Preliminary 
observations  led  to  the  suggestion  that  such  a  technique  is  feasible,  however,  its 
reliability  still  awaits  assessment. 

An  alternative  approach  considered  by  the  Al-'GL  was  to  use  the  automated  array 
of  weather  sensors  composing  MAWS,  augmented  with  a  few  specialized  sensors, 
operating  in  conjunction  with  a  weather-selective  decision-tree  computer  program. 

This  approach  was  felt  to  have  merit  because  of  the  experience  and  empirical 
evidence  gained  on  instrumental  response  to  weather  phenomena  during  the  opera¬ 
tion  of  the  AFGL  Mesonetwork1 1  between  1972  and  1976  and  because  of  independent 

8.  Moroz,  Eugene,  V.  (1977)  Investigations  of  Sensors  and  Techniques  to  Automate 

Weather  Observations,  AFGL-TR-77 -004  1,  AD  A040747. 

9.  Earnshaw,  K.  B.  ,  Wang,  T. ,  Lawrence,  R.  S.  ,  and  Greunke,  R.  G.  (1978)  A 

feasibility  study  of  identifying  weather  by  laser  forward  scattering, 

J.  Am.  Meteorol.  1476- 1481. 

10.  Sanders,  M.J.,  Jr.  (1979)  A  Laser  weather  identifier  system,  Proc.  of  the 

8th  Technical  Exchange  Conference,  28  Nov  -  1  Dec  197  8,  Air  Weather 
Service  TR- <9-001:79-86. 

11.  Hering,  W.  S.  ,  Brown,  H.  A. ,  and  Muench,  H.A.  (1972)  Mesoscale  forecasting 

experiments.  Bull.  Am.  Meteorol.  So^.  53(No.  12):  1  180- 1 183. 
- - -  /kV^ 
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studies  ’  which  documented  the  response  characteristics  of  some  of  the  sensors 

14 

to  different  weather  types.  A  preliminary  report  described  the  instrumentation, 
the  relationships  of  sensors  to  weather  type,  the  decision-tree  program,  and 
demonstrated  the  feasibility  of  the  concept.  The  present  report  documents  the 
details  of  a  14-month  test  of  the  automated  weather  system  and  presents  the  re¬ 
sults  of  their  comparison  with  human  observations. 

2.  INSTRUMENTATION 

2.1  AKGI.  Wealher  Teal  Facility 

F  or  several  years,  AFGL  has  operated  a  Weather  Test  Facility  (WTF)  at 
OFs  AFH,  Massachusetts.  The  W'TF  was  designed  to  serve  as  a  base  for  evaluat- 

g 

ing  new  sensors  under  consideration  for  inclusion  in  the  AW'S  inventory,  for 
collecting  data  to  be  used  in  weather  forecasting  techniques  development,  and  for 
testing  and  improving  weather  automation  methods.  ^ 

The  general  configuration  of  the  WTF’  is  shown  in  Figure  1.  The  facility  con¬ 
sists  of  three  instrumented  towers.  A,  B,  and  C,  arranged  to  measure  weather 
variables  to  heights  of  60  m,  30  m,  and  3  m  along  an  imaginary  aircraft  glide- 
slope.  Two  instrumented  towers,  P  and  Q,  are  located  500  m  on  each  side  of  the 
simulated  approach  zone  and  have  served  as  primary  data  points  in  studies  deter¬ 
mining  weather  event  probabilities  along  the  approach  zone  with  offset  tower 
measurements.  1S  In  addition  a  group  of  state-of-the-art  and  operational  visibility, 
wind,  and  precipitation  sensors  are  located  at  Site  X. 

Since  the  purpose  of  this  research  was  to  incorporate  an  automatic  determina¬ 
tion  of  weather  into  the  MAWS,  the  decision  was  made  to  select  a  basic  MAWS 
complement  of  instruments  present  in  the  WTF  and  duplicate,  as  nearly  as  possible, 
the  MAWS  itself.  Thus,  data  were  collected  and  analyzed  only  from  Tower  A  and 
the  complex  of  surface  instruments  at  Slit  X.  The  wind,  temperature,  dew  point, 
and  visibility  instruments  at  A  and  X  fulfilled  the  basic  MAWS  instruments  require¬ 
ments. 

12.  Chisholm,  D. ,  and  Jacobs,  L.  P.  (1975)  An  Evaluation  of  Scattering  Type 

Visibility  Instruments,  AFGL-TR-75-04ll,  Aii  B01O224L. 

13.  Sheppard,  B.  E.’(1978)  Calibration  of  Scattering  Function  Visibility  Sensors  at 

Toronto  International  Airport,  March  1973  to  December  1975.  UDC:551, 

508.  92,  TR4,  Environment  Canada-Atmospheric  Environment. 

14.  Brown,  H.  A.  (1979)  Preliminary  Assessment  of  an  Automated  System  for 

Detecting  Present  Weather,  AFGL-'rR-79-6l3,l,  Ad  A078031. 

15.  Bering,  W. ,  and  Geisler,  E.  B.  ( 1 97 8)  Forward  Scatter  Meter  Measurements 

of  Slant  Visual  Range,  AFGE-TR-78-0191,  AD  A064423. 
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Figure  1.  Configuration  of  Instrumented  Towers  and  Ground  Site  at  AFGL 
Weather  Test  Facility,  Otis  AFB 


2.2  Weather  Sensors 

Before  preceding  to  a  discussion  of  the  decision-tree  program,  the  observations 

it  produces  and  their  verification,  a  brief  summary  of  the  weather  sensors  used  in 

this  study  will  be  given.  A  more  detailed  description  of  the  automated  sensors  can 

14 

be  found  in  a  previous  study. 

Visibility  measurements  were  made  with  four  types  of  instruments:  the  EG&G 
Model  207  Forward  Scatter  Meter  (FSM),  the  transmissometer  (TRANS),  the 
Impulsphysics  Back  Scatter  Meter  (VIDF),  and  the  MRI  Model  1550  Integrating 
Nephelometer  (NEPH).  Wind  directions  and  speeds  were  obtained  from  Climatronics 
Wind  Mark  I  wind  sets.  Temperatures  and  dew  points  were  measured  with  EG&G 
Model  110S-M  sensors,  and  precipitation  was  recorded  with  a  Belfort  Model  5-405 
tipping -bucket  rain  gage. 
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3.  AUTOMATED  DECISION-TREE  PROGRAM 


The  contents  of  an  aviation  weather  observation  are  based  on  agreements  be¬ 
tween  the  World  Meteorological  Organization,  international  and  domestic  aviation 
interests,  and  civil  and  military  weather  services.  Table  1  lists  the  current 
elements  available  to  observers  to  categorize  weather  occurring  at  a  given  time. 
Much  discussion  could  be  generated  relative  to  the  merits  or  necessity  of  many  of 
the  elements  in  this  table.  Obviously  some  are  more  important  than  others  for 
aviation  purposes.  The  principal  effort  in  this  study  was  to  automatically  determine 
as  many  of  these  elements  as  possible.  Consideration  of  the  instrument  array 
available  at  the  Otis  WTF  led  to  the  selection  of  the  elements,  denoted  in  Table  1, 
for  testing  in  the  system. 

Table  1.  Symbols  for  Weather,  Obstructions  to  Vision  and 
Precipitation  Intensity.  Closed  circles  opposite  symbols 
denote  inclusion  in  the  Automated  Decision-Tree  Program, 

(from  Federal  Meteorological  Handbook  No.  1,  see 
Reference  18). 


Weather  Symbols 

T 

Thunderstorm 

O 

RW 

Rain  Showers 

T  + 

Severe  Thunderstorm 

• 

S 

Snow 

A 

Hail 

SG 

Snow  Grains 

IC 

Ice  Crystals 

SP 

Snow  Pellets 

IP(W) 

Ice  Pellets  (Showers) 

o 

SW 

Snow  Showers 

• 

L 

Drizzle 

• 

ZL 

Freezing  Drizzle 

• 

R 

Rain 

• 

ZR 

Freezing  Rain 

Obstructions 

to  Vision 

m 

BD 

Blowing  Dust 

• 

H 

Haze 

BN 

Blowing  Sand 

D 

Dust 

• 

BS 

Blowing  Snow 

• 

F 

Fog 

BY 

Blowing  Spray 

• 

GF 

Ground  Fog 

• 

K 

Smoke 

• 

IF 

Ice  Fog 

Precipitation  Intensity  Symbols 

Very  light 

• 

Absence  of  symbol 

indicates  moderate 

except  for  A  and  IC 

• 

- 

Light 

• 

* 

Heavy 

II 


U 


Rain  and  snow  showers  are  denoted  as  partially  included  because  the  program 
generates  an  observation  each  minute.  Thus  showery  conditions  can  be  deduced 
by  noting  rapid  variations  in  precipitation  intensity. 

The  major  elements  missing  in  the  AFGL  automated  weather  decision-tree 

program  are  thunderstorms  (T,T+),  and  hail  (A).  Several  attempts  to  detect 

1 6 

thunderstorms  were  discussed  in  a  previous  paper  using  techniques  other  than 

17 

radar.  In  addition,  instruments  have  been  designed  which  appear  capable  of 
automatically  measuring  the  momentum  impacted  to  a  sensing  device  by  a  hailstone 
strike. 

3.1  Obstructions  to  Vision  Program 

The  obstructions  to  vision  (OV)  section  of  the  decision-tree  program  was  de¬ 
signed  to  be  initiated  whenever  the  visibility,  as  measured  by  an  FSM,  decreased 
to  less  than  seven  miles  (denoted  by  an  extinction  coefficient  of  3  X  10  m  ).  A 
simplified  flow  diagram,  upper  diagram  in  Figure  2,  illustrates  the  branches 
available  in  the  decision  tree  for  detecting  the  appropriate  OV  element. 

Following  an  initial  visibility  reading  which  is  less  than  seven  miles,  editing 
routines  in  the  program  determine  whether  the  observation  is  valid.  These  checks 
consist  of  comparisons  with  other  FSM's  on  the  tower  or  at  site  X.  The  tendency 
of  the  FSM  occasionally  to  detect  scattering  from  non-visibility  reducing  sources 
is  thus  taken  into  account. 

Given  that  the  observation  is  valid,  a  test  of  the  temperature-dew  point  differ¬ 
ence  determines  whether  the  "wet''  or  "dry"  branch  of  the  tree  will  be  followed. 

Kog  of  some  type  will  be  repot*ed  if  the  temperature-dew  point  difference  is  less 
than  6°C.  If  the  difference  is  equal  to  or  greater  than  6°C,  then  the  program 
branches  and  tests  are  made  for  wind  gusts,  nephelometer  values,  and  vertical 
profiles  of  extinction  coefficient  (EXCO)  ir.  order  to  differentiate  haze,  or  blowing 
sand  and  dust,  and,  in  some  cases,  blowing  snow. 

If  the  temperature-dew  point  difference  is  less  than  O'C,  then  the  program  is 
directed  to  an  examination  of  the  vertical  gradient  of  EXCO.  If  the  EXCO  at  the 
uppermost  level  of  the  tower  is  significantly  less  (60%)  than  at  the  lowest  level,  then 
ground  fog  (GF)  is  chosen  as  the  obstruction.  If,  however,  the  upper  level  EXCO 
is  similar  to  or  greater  than  the  lower  level,  then  fog  (F)  is  selected.  A  final 
temperature  test  is  considered  to  detect  the  rare  event  of  ice  fog  (IF). 


16.  Petrocchi,  P.  J.,  and  Paulsen,  W.  H.  (1973)  Lightning  Warning  Set  Test  Report, 

AFCRL-TR-73-0370,  AD  A770014. 

17.  Dennis,  A.  S.  ,  Smith,  P.  f.  ,  Peterson,  G.A.P.  ,  and  McNeil,  H.  D.  (1971) 

Hailstone  size  distributions  and  equivalent  radar  reflecting  factors  computed 
from  hailstone  momentum  records,  J.  Meteorol.  10:79-85. 

✓vW\ 
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3.2  Present  Weather  Program 

The  lower  diagram  of  Figure  2  depicts  the  flow  diagram  for  the  present 
weather  (PW)  section  of  the  decision-tree  program.  It  is  activated  by  one  tip  of 
the  heated  tipping -bucket  rain  gage.  Validity  checks  with  the  FSM's  then  deter¬ 
mine  whether  the  tip  is  spurious,  an  infrequent  occurrence. 

The  determination  of  precipitation  intensity  divides  the  program  into  two  major 
branches  — light  precipitation  to  the  left,  moderate  and  heavy  to  the  right.  Tempera¬ 
ture  tests  are  performed  next  and  if  the  temperature  is  less  than  0.  5°C  the  flow  is 
directed  to  the  "frozen"  branch.  At  that  point  tests  are  made  to  determine  if  the 
VIDE  is  significantly  greater  (50%)  than  the  FSM.  If  it  is,  then  snow  (S)  is  reported. 
If  it  is  not,  then  another  test  is  made  between  the  FSM  and  the  TRANS.  If  they  are 
similar,  freezing  drizzle  (ZL)  is  reported.  The  drizzle  category  is  classified 
further  into  light,  moderate,  or  heavy,  depending  on  visibility  criteria. 

If  the  temperature  is  equal  to  or  greater  than  0.  5“C,  the  flow  proceeds  to 
the  "liquid"  branches  which  consist  of  rain  and  drizzle.  The  primary  test  in  the 
light  precipitation  branch  is  the  comparison  of  FSM  and  TRANS  to  discriminate 
between  rain  (R)  and  drizzle  (L).  Drizzle  (L)  is  then  further  classified  as  light, 
moderate,  or  heavy,  depending  on  the  visibility.  An  additional  test,  a  comparison 
of  VIDE  and  FSM,  is  performed  in  this  branch  if  the  temperature  is  less  than  3°C. 

If  the  VIDE  exceeds  the  FSM  significantly  (50%),  the  decision  tree  will  select  snow. 


4.  OBSERVATIONS 

The  total  decision-tree  program  (AUTO)  produced  1-min  averages  of  all  ob¬ 
served  meteorological  variables  together  with  the  determination  of  the  present 
weather  (PW)  and  obstruction  to  vision  (OV).  Several  samples  have  been  selected 
to  illustrate  the  versatility  of  the  program  and  to  show  the  comparable  human 
observations. 

The  first  sample.  Figure  3,  shows  data  collected  on  8  June  1978  between  0900 
and  0959  GMT.  It  was  selected  to  illustrate  the  capability  of  the  program  to  de¬ 
pict  the  rapidly  changing  weather  conditions  during  a  thunderstorm.  Column  1 

indicates  the  time  of  observation  bv  minute.  Columns  2  through  6  are  values  of 

-4-1 

extinction  coefficient  (X10  m  )  measured  by  FSM's  at  four  levels  of  Tower 
A(A200-57  m,  A150-48  m,  A100-29  m,  and  A50-16  m)  and  at  the  3  m  level  at 
site  X.  Column  7  contains  the  extinction  coefficients  measured  by  the  TRANS. 
Columns  8  through  17  depict  the  1-min  averages  of  temperature  (TMP  XIOdegrees  C) 
at  the  FSM  levels  of  Tower  A,  followed  by  the  temperature-dew  point  difference 
(DPS)  at  the  same  heights.  Column  18  shows  a  1-min  count  of  the  number  of  tips 
made  by  the  rain  gage  (each  tip  denotes  0.  005  in.  of  precipitation).  The  next 
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column,  19,  gives  the  extinction  coefficient  (X10  ,  )  obtained  from  the 

nephelometer  (NEPH).  Column  20  displays  the  back  scatter  meter  (VIDE)  observa¬ 
tion  of  extinction  coefficient;  column  21,  the  decision-tree  program's  determina¬ 
tion  of  the  present  weather  and  obstruction  to  vision;  and  finally,  the  last  column, 
the  weather  observations  recorded  by  the  FAA  observer  for  the  same  period. 

The  major  features  of  interest  are  the  periods  of  intense  rain  reflected  in  the 
higher  extinction  coefficient  (lower  visibilities)  of  the  visibility  instrument,  columns 
2  through  7  and  20;  the  rain-count  produced  by  the  tipping-bucket  rain  gage, 
column  18;  the  observations  by  the  present  weather  program  (on  a  minute-by- 
minute  basis);  and  the  corresponding  observations  bv  the  FA  A  observer.  It  is 
apparent  that  the  AUTO  is  more  capable  than  a  human  in  tracking  rapidly  changing 
weather  events. 

The  next  example.  Figure  4,  was  selected  to  illustrate  the  AUTO  observations 
generated  during  a  period  of  haze.  The  principal  instruments  used  by  the  AIJTO 
to  determine  haze  are  the  vertical  array  of  visibility  meters,  FSM  (columns  2 
through  6);  the  temperature-dew  point  sets,  TMP  and  DPS  (columns  8  through  17); 
and  the  nephelometer,  NEPII  (column  19). 

The  vertical  profile  of  visibility  (columns  2  through  6)  shows  a  restriction  to 
visibility  at  the  lowest  level  which  increases  with  height.  The  60-min  of  observa¬ 
tion  also  show  the  increase  in  this  visibility  restriction  with  time.  The  initial 
minute  contained  EXCO's  sufficiently  high  to  activate  a  search  for  visibility  ob¬ 
struction.  The  temperature-dew  point  values  (columns  8  through  17)  indicate  high 
humidities,  but  prior  to  selecting  fog  as  an  observation  the  AUTO  examines  the 
nephelometer  (NEPII)  reading  (column  19).  Comparison  of  the  magnitude  of  the 
NEPII  with  the  X  FSM  shows  their  equivalence,  therefore,  AUTO  selects  haze  (11) 
for  the  observations.  The  one  FAA  observation  at  0255  GMT  shows  a  similar 
dete  rmination. 

The  next  illustration.  Figure  5,  was  selected  to  demonstrate  the  AUTO  ob¬ 
servations  during  the  hour  that  followed  Figure  4.  At  the  beginning  of  the  hour  the 
comparison  of  the  NEPII  and  the  X  F.  M  resulted  in  a  haze  (H)  selection  alone.  How¬ 
ever,  the  FSM's  at  Site  X  began  to  observe  lower  visibilities  as  the  hour  proceeded 
and  quickly  exceeded  the  NEPII  in  magnitude.  Since  there  was  also  a  significant 
restriction  measured  by  the  NEPII,  AUTO  chose  fog  and  haze  (KH)  for  the  observa¬ 
tion  during  most  of  the  hour;  the  FAA  observation  at  0355  GMT  indicates  the  same 
phenomena. 

The  vital  role  of  the  tower  FSM's  in  determining  ground  fog  (GF)  is  illustrated 
in  Figure  8.  The  period  of  observation  occurred  between  0600  and  0659  GMT  on 
4  November  197  8.  The  lowest  level  FSM  located  at  X  (column  6)  recorded  an 
extremely  high  EX(’t)  throughout  the  hour  and  is  in  good  agreement  with  the  other 
ground-based  visibility  instruments  at  the  X-location,  TUANS  (column  7)  and  VIDE 
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(column  20).  At  the  same  time,  the  EXCO's  measured  at  the  higher  levels  of  the 
tower  (columns  2  through  5)  show  increasing  visibility  with  height  throughout  the 
hour,  indicating  that  the  obstruction  to  vision  was  a  shallow  phenomenon.  The  AUTO 
determined  ground  fog  (GF)  as  the  most  appropriate  obstruction.  The  FAA  observer 
at  0655  GMT  reported  ground  fog  in  all  quadrants. 

The  next  illustration.  Figure  7,  was  selected  to  show  the  response  of  the  AUTO 
during  a  period  of  snow.  The  data  were  collected  on  7  February  1979  between 
2300  and  2359  GMT.  The  extinction  coefficient  measured  by  the  tower  FSM's 
(columns  2  through  6)  show  very  little  variation  in  the  vertical,  a  characteristic  of 
snow  or  rain.  The  temperature  and  dew  point  readings  (columns  8  through  17) 
record  temperatures  (-5  to  -S^C)  below  freezing  and  dew  point  spreads  of  1  to  2°. 

The  nephelometer  (NEPH)  shows  no  significant  contribution  to  the  extinction  coeffi¬ 
cient  from  atmospheric  particles.  The  significant  instrument  during  this  period  is 
the  VIDE.  Comparison  of  the  VIDE  with  the  FSM  at  X  shows  it  to  be  well  over  50% 
greater;  therefore,  the  AUTO  selected  snow  (S)  as  the  phenomenon  that  was  occur¬ 
ring.  The  FAA  observer,  at  2323  and  2357  GMT  also  reported  snow. 

The  final  figure  in  this  section.  Figure  8,  illustrates  the  capacity  of  the  AUTO 
to  respond  to  varying  types  of  weather.  The  first  8  min  of  the  hour  contain  ob¬ 
servations  of  freezing  rain  and  fog  changing  to  rain  and  fog.  Criteria  used  to  deter¬ 
mine  weather  for  these  observations  were  visibility  restrictions;  occurrence  of  a 
rain  tip  in  the  previous  5  min;  similarity  of  EXCO's  measured  by  VIDE  and  the  FSM 
at  X;  and  an  initial  temperature  just  above  0°C,  followed  by  an  upward  trend  of 
temperatures. 

From  0108  to  0138  GMT  the  VIDE  exceeded  the  FSM  at  X  by  more  than  50%. 
Therefore,  AUTO  selected  snow.  During  the  same  period  the  vertical  profile  of 
EXCO’s  showed  a  sharp  decrease  in  visibility  with  height,  not  a  normal  profile  for 
snow  alone.  Therefore,  the  AUiO  also  continued  the  fog  observation. 

At  0139  GMT,  the  EXCO  values  of  the  V  IDE  dropped  so  that  they  no  longer 
exceeded  the  FSM  values  at  X  by  50%.  The  rain  gage  still  indicated  that  precipita¬ 
tion  was  occurring  and  that  temperature  was  increasing.  Therefore,  AUTO  selected 
light  rain  and  fog  as  the  appropriate  determination. 

The  verification  of  this  type  episode  is  difficult  unless  an  observer  is  located 
at  the  same  site  and  is  devoting  his  full  time  to  monitoring  the  weather.  The  FAA 
observation  at  0155  GMT  specifies  light  rain  mixed  with  snow.  The  AUTO,  because 
it  was  not  programmed  to  report  snow  and  rain  at  the  same  time,  did  a  good  job  of 
selecting  the  predominant  feature  at  each  minute.  The  end  result  is  a  creditable 
specification  of  the  weather  events  occurring  during  this  particular  hour. 


*20  0  A 150  *100  *50  X  MM  A20u  *15}  *100  *50  X  Ml  h  NfcFH  VIDE  ME*  THEM  FAA 

FSM  fSM  FS*  FSM  FSM  TRW  THP  OPS  T«P  DPJ  TMP  OPS  IMP  OPS  TPF  OPS 


■JK-: 


u. 

t 


i 

cc 


U.  U.U.U.U.  U.U.U.U.U.U.U.  u 


L.  U.  U.  U.  U.  U.  U.  U.  U.  U.  U.  U.  U.  U-  U-  U.U.  U.  U.U.  U.U.  U.  U-  u. 


iMiacjcaM.*  ♦  xqlX  t  i 

mat*** Su:  *u:a'u:rr-*i*arr*at  jca  i  i  i  i  i  i  i  i  i  i  t  i  i  i  *  *  i  AC 

-t-4-i  X-j  j  jacarucoc 


O'CN.n;  ,40  .7X\Jf\JU'U\  .r  ro  T-4t\J  o  crs.tr  ©*4O44r0t\J<r  WlTfslOo  *4 jv*»r7«>  OU'H 

*4  «4r4*4*4,4*4w4M.».T.#*>.rtf\»0S.>0.rin'T\0lMf\ir*4*4»4.4*4w4T444*44-l»>*  *4*4.4  »4<\Jv4  .4*4  *4*4*4  *4  *4,4.4  *4*4*4 


*4  ■  ♦»  MHrHHHr4«iT4  r 


HrtHH  HHH  rt H  WH H 


*4  tvro -j  .» incr>*)'T'm  ;p*4*.  wu'nin *44isru'trt\j  j'U'S'Oi? x>«6cr.r o'tr'^fs ■■'■3o'3'j,ihhw'*i ^ui<i)s<(C0v  jcrcr ~»»hcvj 
o  oao'iooooHHNN»o«  ,*  ^uM/t^to>css>t)0'4oio(ieo  o Ttrtr  Ttrtrff*(T j*<rtr ▼'tr^'.'^'rfrCT'trtr 
W  ^MH>4Hr4r4rtHH^Hv4rtW>4  r«H^H  *4,4  4H 


in  ifl4>ai\Oit)vp4)iiMri£kr'>Oi)i0sO  iOiC<tf  ukqcai  o  oii<ito  o  u«j<ctOij>cT'cr  cr  n oo  ossu\ ^(*5 

rw  *.rst*»r»«teis.»hr»«^rK's.''«'^*.rKiKfs.<*.«^''^s.K.<sf«.<^f'»*.SK.rs*teK.K.K-*.i'»’<«.<K'KrKrs>Kf*.r*fKfKr>kSrK  y**;ss s*»— sss 


<r  5Hrtrff'»r®*r  wc  c 


s  s.  'Off'tTJ'O'Otr®  ©sO«>  ©  ©  JMP9>  4)W(T  O  J'ff'lTtr  UOOli 


«o  s*>©>©  .©©.0  ©>© ucros'r crcr O'er 'T‘,3r3 ^  "r  '"oocr  »c»o *4'-s r  ©s.  ©ir 
S.  SSSMV.SSSSSSSSSSSSSSSS.SSSSS  o  OK.SS  K.K.SS.S,  o«  ®  S.  <©  ©  *'»  <®  ©•  «D  0  0««0  OSSSSS 

U>  ON©  ©  ©  ©©  ©  ©©©K-  ©S.K.K.  «>h~S.  X)  «0«o  ©  ©  OSSSS\>«S  OSSSSkSS  K.K.PKS-S.K.S.K.S.N.SfsSK.S-s,  K.S.©  ® 
t  I  I  »  I  I  I  I  »  I  I  »  •  I  I  I  I  I  •  •  •  «  I  I  «  I  #  I  «  I  t  I  I  •  •  I  I  I  I  I  •  I  »  I  I  •  •  *  4  I  •  •  »  •  •  •  •  1  I  • 


O'  (TcrcrTcrcr ®  ©©xiO <T«c  ©  x>«  *3JO  *3  a®«  ro  0*4.4  *4  *4  aa  ,^*400*4*4.4,4  *4*4*4*4*4  *4t\jrg  r\j(\jr.jrj<\jr\j,4.:>o  0-00 
©  ©©  ©©©©©©©©©©©©©©©©©  ®©®©K.S.S-S-N.K.f^K.K.N-S.S.K.K.^s.s.K.S.N-K.S.fK.r^S.S.K.S.S*S»S.S*S.©©© 

>0  vOvO>0'X>1o^)voiri®irN>r>  DirufMr tr 'f\crur<ri<MfMM/\vOiA,rir>inAir\ir’piiMfM/'i/vrNinuMr'f'cMr vx>ir4>ir cruMri/Mrururnr-rii'ir 


i©  ©»©  ©i/ii©ini/>t/></>y>i/'©i/>.i©inir  ©©©©©©*,*.*>«>«>«>«>(©  ©is©*'©©®®*©©®*'©*. 

K  K.K.fsS.K.K.K.SSS.K.  S.S.S.K.  K.  S.S N. S.  IsS-  is  M^SSK  N.S. K.  K. S.S. K.  S. S.  *.*. S.S. S-K. *. S* K.K.  P-  S.S  S.P-K. S.K.N.SS.  S. 


©  ©©©K*S.S.S.S.S.S.SN.K.«>^®S.S.  ®  <040«OK. SS^N S. «ss fs S.SS. HkK^KK N.SK. N.S.»s©S-S.S* SS.S. ,©<«> O <T  tlviJ 

I  t  I  I  I  I  t  I  I  I  t  I  •  I  I  »  (  I  I  I  I  I  I  I  I  I  f  I  «  I  I  I  (  I  I  I  «  I  I  |  I  I  (  I  I  I  (  t  «  I  I  •  I  I  I  I  I  •  <  > 


S-  SSSKSSKSSS.SSS.SM>. 


r  «  ^  irtu\  u>^  <r  u\  tf\«o«0*i>4MMAUN  w 

■4 


•c  s.®s.vOa>-®«vjc»os-s.to»4<rfss5« jro#pos.<3^t<rs.»s®9®(r«<rK-s.«cvDUN*ou'Ks.»o 
«-tcM(\i  «4  <4«sj^  to  jr  ^rsj  n  w  ^  »o  *-< 


«^H»4(r<T'^K>»»0*«0'NOS 


a  u«nir«ioi»nf>m>00X'i0<09*rgi0no‘3^^«nHff'o9oosNso4tf)MUMA«,3M*4^s*')(rNO'st0<0on<rssn 

«4  4HH«N  OO«N>OHa^SiOnin9*t4O0  #S^OS«>OIVi4W»40®ktfiflSSff'®a'iflSS>|}lA#Ofl'(T'ff'»t*<«l/'M 


*4  WO®WajO*SH(J*®W(J'W*'5JinsW«MiAmff>0«(NJt»)4IMlftH(gsfl*U\^SW''1'’4>*'M®®N,WK^^w,,^®''®<,'K 

«4  «4«4  *<»4»1^ ^M^^S  (T«0®li*'lf'«»S®  «4v4«4*4v4W  *4»4»<4^^*4^  HWt4H4 

iv  *»■#  -rocrer^  ^cr*4ir  ^®>^®ok«os- tr  tv  kjit  os- ir>o®tro^rg«^*»®N.s0^s.s>a'«o(r®cr«4ri^o<rcr(r»4Mtr>^>0 

r4  HH>4*I  *4NP)i0tf«^in>{IS(rS>fi>0IA0Si6IAN^H  hHH«4>4H  »4*|H»4f<*tHH  *4»l*IHrt 


w  6 


m  sx*^^  »4s£)«4  <rir>s.  s.»o»4»4(r  cr^)s-<rir> ■«  cr*4.o  »o  ^*ir>M(r®fo<r^»^<r'»(r 

<r  sotr*sK.isoss«vivoMMMM»o®ir^^str(vii\«'*oir«os<r«<T«®'*iMiMr^iA^*>®*NNyoK>fsi‘M«sK.s.|T<r«»^® 

•4  *4  r4«M^  ®^^^^M/\^KJ*4  *4 *4*4 -4 *4  t4  «4«4 


a  *4<sjm^»r®s «<Tc»*4M*n^u>®s«<Ta*4f\iio  ^u'^>s®tro^M'o-»ir ®s.®tr  o«4MK)^u\.os«(To*4(\ifo^ir  >OS>«ir 


Figure  3.  Example  of  One  Hour  of  Automated  Decision-Tree  Program  Output  Beginning  at  0900  GMT. 
8  June  1978.  FAA  weather  observations  are  plotted  at  extreme  right 


Example  of  One  hour  of  Automated  Decision-Tree  Program  Output  Beginning  at  0200  GMT 
1978.  FAA  weather  observations  are  plotted  at  extreme  right 
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Figure  6.  Example  of  One  Hour  of  Automated  Decision-Tree  Program  Output  Beginning  at  0600  GMT, 
4  November  1978.  FAA  weather  observations  are  plotted  at  extreme  right 
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Figure  7.  Example  of  One  Hour  of  Automated  Decision-Tree  Program  Output  Beginning  at  2300  GMT, 
7  February  1979.  FAA  weather  observations  are  plotted  at  extreme  right 
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Figure  8.  Example  of  One  Hour  of  Automated  Decision-Tree  Program  Output  Beginning  at  0100  GMT, 
18  January  1979.  FAA  weather  observations  are  plotted  at  extreme  right 


5.  COMPARATIVE  ANALYSIS  OF  OBSERVATIONS 


The  verification  of  the  automated  weather  observations  was  accomplished 
through  comparison  with  observations  made  by  FAA  control  tower  personnel  at 
Otis  AFB.  The  tower  is  located  about  1.  5  km  east  of  the  WTF.  The  FAA  has 
responsibility  for  taking  the  official  weather  observations  at  Otis  AFB  and  provided 
us  copies  for  the  14-month  period  of  the  test. 

1 8 

Weather  observers  are  required  to  make  a  "record"  observation  every  hour. 

The  procedure  is  to  start  the  observation  within  15  min  of  its  scheduled  time  and 
record  the  time  the  last  element  is  observed.  Since  the  AUTO  observations  were 
available  every  minute,  predominant  weather  elements  observed  during  the  15  min 
prior  to  the  FAA  record  observations  were  determined  and  verified  with  the  FAA 
observations. 

It  is  worthwhile  to  restate  that  the  portion  of  the  aviation  weather  report  we 
automated  is  composed  of  two  elements,  present  weather  and  obstructions  to  vision. 
Consequently  two  verifications  were  performed.  For  the  purpose  of  these  verifica¬ 
tions  there  are,  generally  speaking,  five  types  of  observations  possible  by  the  AUTO 
and  the  FAA: 

(1)  Obstruction  of  vision  only  (OV), 

(2)  Present  weather  only  (PW), 

(3)  Obstruction  of  vision  and  present  weather  (OV  and  PW), 

(4)  No  weather, 

(5)  No  observation. 

Thus,  twenty-five  possible  combinations  of  FAA  and  AUTO  observations  may  occur. 
The  OV  verification  consisted  of  matching  only  the  OV  elements  in  both  observa¬ 
tions.  For  example,  if  both  the  FAA  and  AUTO  observed  rain  and  fog  only,  the 
OV  element,  fog,  was  considered.  The  PW  elements  (in  this  example,  rain)  were 
compared  in  the  PW  verification.  If,  on  the  other  hand,  the  FAA  observed  rain  and 
fog  while  the  AUTO  observed  rain  alone,  this  observation  was  counted  as  a  verifica¬ 
tion  for  the  PW  program  but  a  miss  for  the  OV  program.  Therefore,  in  the  follow¬ 
ing  discussions  of  the  verification  of  the  two  programs,  although  the  same  basic 
observation  set  was  used,  the  numbers  recorded  in  similar  elements  do  not 
necessarily  coincide. 


18.  Federal  Meteorological  Handbook  No.  1  (1972)  Surface  observations,  A3, 
Superintendent  oi  Documents,  U.  S.  Government  Printing  Office, 
Washington,  D.  C. 


5.1  Obstructions  to  Vision  Verification 

The  obstructions-to-vision  observations  were  expanded  to  a  10  X  10  con¬ 
tingency  table.  Figure  9.  The  first  seven  columns  and  rows  are  labeled  with  the 
specific  OV  element.  The  meaning  of  each  symbol  is  given  in  Table  1.  The  FAA 
observations  are  listed  and  summed  in  columnar  form  while  the  AUTO  observations 
are  listed  and  summed  in  rows.  Thus  the  sums  of  the  columns  denote  the  frequency 
of  the  events  observed  by  the  FAA  during  the  14-month  study  while  the  row  sums 
denote  the  AUTO  frequency.  Columns  and  rows  labeled  PRES  WX  refer  to  the 
number  of  hours  when  only  a  present  weather  element  was  observed.  Those  labeled 
NO  WX  denote  those  cases  where  no  weather  was  observed.  Finally,  NO  OB  refers 
to  the  cases  when  no  observation  was  available. 
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Figure  9.  Verification  of  Fourteen  Months  (March  1978 
through  April  1979)  of  Obstruction  to  Vision  Observations 
Generated  by  the  Automated  Decision-Tree  Program  With 
FAA  Weather  Observations.  Summation  of  columns 
represents  frequency  of  event  observed  by  FAA,  summa¬ 
tion  of  rows  represents  frequency  observed  bv  AUTO 
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In  the  discussions  that  follow,  a  particular  element  in  the  matrix  will  be  re¬ 
ferred  to  by  coordinates  defining  each  column  and  row.  For  example,  FH/F  will 
designate  that  element  representing  the  number  of  hours  of  fog  and  haze  (FH) 
observed  by  the  FAA  while  the  AUTO  was  specifying  fog  only  (F). 

The  principal  diagonal  (H/H,  F/F,  and  so  on)  shows  that  the  AUTO  was  in 
agreement  with  the  FAA  in  82%  of  the  observations  when  all  diagonal  elements  are 
considered.  If  we  consider  the  obstruction  to  vision  alone,  the  AUTO  was  able  to 
duplicate  the  FAA  in  69%  of  the  observations. 

Other  areas  of  particular  interest  are  those  which  denote  good  but  not  perfect 
agreement.  The  elements  Fll/H,  H/FH,  F/FH  and  F11/F  which  agree  in  one 
obstruction  only  may  be  attributed  to  human  causes  because  of  .he  subjective  nature 
of  discriminating  between  fog  and  haze,  whereas  the  AUTO  system  relies  on  the 

NEPH  and  FSM  to  discriminate  between  the  two.  If  the  NEPH  and  FSM  measure 

-4  - 1 

EXCO's  of  equal  magnitude  which  are  greater  than  3X10  m  ,  but  less  than 

21  X  10  ^  m  the  AUTO  selects  haze  alone.  If  the  NEPH  measures  an  EXPO 
-4  - 1 

less  than  3  X  10  m  while  the  FSM  records  one  greater  in  magnitude,  then 

AUTO  selects  fog  alone.  Finally,  if  the  NEPH  reading  is  less  in  magnitude  than 

-4  - 1 

the  FSM  but  still  greater  than  the  3  X  10  m  threshold,  then  fog  and  haze  are 
selected  by  AUTO.  The  same  rules  apply  for  the  AUTO  selections  in  the  F/H  and 
H/F  categories.  Perception  of  fog  and  haze,  however,  differs  among  individual 
observers,  as  indicated  by  changes  in  observations  from  fog  to  haze  and  vice  versa 
from  one  work  shift  to  the  next.  Many  of  the  F/H  cases  began  at  night  when  human 
discrimination  between  fog  and  haze  is  particularly  difficult.  This  could  account 
for  the  greater  number  of  observations  in  the  F/H  category  than  in  the  H/F.  The 
remaining  cases  showed  a  tendency  of  the  human  observer  to  report  haze  in  the 
higher  ranges  of  visibility  restriction  and  fog  in  the  lower. 

Only  seven  observations  of  blowing  snow  (BS/F,  BS/GF,  BS/NO  WX)  occurred 
during  the  study  and  AUTO  failed  to  correctly  specify  them.  Instead,  AUTO  ob¬ 
served  light  snow  and  fog  (S-F)  in  two  cases  and  in  two  other  cases  light  snow  and 
ground  fog  (S-GF)  because  the  wind  gust  determination  was  functioning  improperly. 
In  the  three  remaining  cases  AUTO  observed  no  weather  because  it  was  reporting 
visibilities  of  seven  to  eight  miles  which  require  no  obstruction  to  vision  determina¬ 
tion,  while  the  FAA  reported  visibilities  of  less  than  seven  miles  which  da  require 
obstruction  determination. 

Combining  individual  elements  of  visibility  restriction  into  broader  groups  was 
accomplished.  Figure  10,  using  rationale  analogous  to  that  used  in  the  preceding 
fog-haze  discussion,  the  purpose  being  the  highlighting  of  the  strengths  and  weak¬ 
nesses  of  the  AUTO  program. 
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Figure  10.  Simplification  of  Figure  9  Through  Categorization 


Categories  labeled  A  and  A'  were  discussed  in  ihe  preceding  paragraph.  Cate¬ 
gory  B  has  two  sections.  The  first  specifies  the  number  of  observations  of  ground 
fog  (OF)  by  the  FAA  while  the  AUTO  reported  fog  or  haze;  the  second  specifies 
the  opposite  set  of  conditions.  There  is  a  large  disparity  in  the  number  of  observa¬ 
tions  between  the  sections.  The  numbers  here  and  in  Figure  9  indicate  that  the 
AUTO  observes  ground  fog  much  more  frequently  than  it  should.  Since  the  criterion 
for  selection  of  ground  fog  is  based  on  the  percentage  variation  of  visibility  with 
height,  it  is  apparent  that  this  criterion  should  be  adjusted. 

The  first  section  labeled  C  contains  the  number  of  observations  (193)  that  the 
FAA  reported  a  present  weather  element  (PRES  WX)  only  while  the  AUTO  reported 
an  obstruction  to  vision  (OV)  or  a  combination  of  OV  and  PW.  In  about  140  of  these 
cases  the  FAA  observed  either  snow  or  rain  alone  while  the  AUTO  observed  snow 
and  fog  or  rain  and  fog.  Thus,  following  our  verification  scheme,  they  were  con¬ 
sidered  as  failures  in  the  OV  program,  but  wore  considered  as  verifications  in  the 
PW  program.  These  observational  differences  can  be  attributed  to  two  possible 
causes,  a  characteristic  of  the  AUTO  program  to  search  for  an  obstruction  to  vision 
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in  addition  to  a  present  weather  element  when  the  visibility  is  less  than  seven  miles, 
and  a  bias  on  the  part  of  the  FAA  observer  to  allow  a  present  weather  element 
alone  to  account  for  the  total  restriction  to  visibility. 

The  remaining  53  observations  consisted  of  FAA  reports  of  snow  or  rain  and 
of  AUTO  reports  of  fog,  ground  fog,  haze,  or  fog  and  haze.  These  are  entirely 
attributable  to  the  AUTO  rain  gage.  In  these  cases,  either  no  tip  occurred  or  it 
was  delayed  beyond  the  hourly  observation  time  because  precipitation  was  very  light. 
In  all  these  cases,  however,  the  AUTO,  noted  a  decrease  in  visibility  below  seven 
miles,  and  sought  a  cause  in  the  ()\  portion  of  the  decision  tree. 

In  the  second  section  of  (.',  the  AUTO  observed  present  weather  only  four  times 
while  the  FAA  was  observing  fog.  In  these  cases,  the  AUTO  did  observe  a  tip  of 
the  rain  gage  but  because  of  time  or  distance  separation  the  FAA  did  not  observe 
precipitation.  The  AUTO  also  determined  visibility  to  be  greater  than  seven  miles 
and,  therefore,  indicated  no  obstructions,  while  the  FAA  reported  visibilities  of 
five  and  six  miles  and  observed  fog  as  the  obstruction. 

Categories  D  list  the  number  of  times  when  the  FAA  reported  no  weather  while 
the  AUTO  reported  an  obstruction  and,  conversely,  the  number  of  times  when  the 
AUTO  reported  no  weather  while  the  FAA  recorded  some  restriction  to  visibility. 

The  number  of  times  this  occurred  is  similar  in  both  categories.  Closer  examina¬ 
tion  of  the  individual  cases  revealed  two  causes  for  these  discrepancies.  This  first 
is  based  on  the  rule  which  requires  a  restriction  to  visibility  to  be  reported  when 
the  visibility  is  less  than  seven  miles.  In  about  50%  of  the  observations  the  AUTO 
and  FAA  observed  visibilities  on  opposite  sides  of  this  value.  The  second  cause, 
which  accounted  for  the  remainder  of  the  discrepancies,  was  due  to  the  distance 
between  the  two  observation  points.  This  space  separation  manifested  itself  in 
time  differences  of  onsets  and  clearings  of  fog  and  ground  fog. 

The  fifth  category,  K,  documents  the  number  of  times  either  system  failed  to 
make  an  observation  during  the  14-month  period.  The  AUTO  failed  to  function  in 
394  cases.  This  4%  down-time  of  the  AUTO  was  due  to  malfunctions  of  the  data 
recording  system.  The  FAA,  on  the  other  hand,  was  unable  to  file  observations 
for  51  hr  because  of  tower-hcating-system  failure  during  an  extremely  cold  period. 

The  final  category,  F,  which  relates  the  number  of  times  one  system  reports 
present  weather  while  the  other  reports  no  weather  and  conversely,  is  really  a 
partial  report  on  the  present  weather  system  discussed  in  detail  in  Section  5.  2.  The 
higher  frequency,  4  1,  of  U RES  VVX/NO  WX  was  due  to  two  causes:  first,  the  dis¬ 
tance  between  observation  points  which  resulted  in  different  beginning  or  ending 
times  of  precipitation:  and  second,  light  precipitation  (either  snow,  drizzle,  or 
rain)  to  which  the  rain  gage  was  inherently  slow  in  reacting,  coupled  with  visibilities 
greater  than  seven  miles.  The  eight  occurrences  in  NO  WX/PKES  WX  were  due 
to  station  separation. 


5.2  I’roscnl  Weather  Verification 


The  present  weather  verification.  Figure  11,  consists  of  the  FAA  and  AUTO 
hourly  observations  for  the  14-month  period  of  study  arranged  in  a  9  X  9  matrix. 
The  first  five  rows  and  columns  of  the  matrix  are  the  weather  elements  selected 
from  Table  1.  The  remaining  rows  and  columns  allow  for  the  possibility  of 
obstruction  to  visibility  only  (OSTN  to  VISN),  no  obstructions  or  weather  (No  WX) 
and  no  observations  available  (No  OB). 
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Figure  11.  Verification  of  Fourteen  Months  (March  1978 
through  April  1979)  of  Present  Weather  Observations 
Generated  by  the  Automated  Decision-Tree  Program  (AUTO) 
With  FAA  Weather  Observations.  Summation  of  columns 
represents  frequency  of  events  observed  by  FAA,  summation 
of  rows  represents  frequency  observed  by  AUTO 


The  principal  diagonal  gives  a  remarkably  high  agreement  of  86%.  Major  con¬ 
tributions,  however,  to  this  agreement  are  from  the  two  categories  involving 
obstructions  to  vision  and  no  weather.  This  simply  reflects  the  low  frequency  of 
present  weather  events  at  (His  AFB  during  the  14-month  period.  For  example,  the 


KAA  frequency  of  weather  events  can  be  obtained  by  summing  the  columns  titled 
ZR,  S,  R,  and  L.  They  total  1129  and  indicate  that  weather  occurred  during  only 
11%  of  the  14-month  period  of  observations.  Considering  those  events  alone,  the 
AUTO  correctly  identified  627,  or  56%,  of  them.  Most  of  the  inconsistency  in  PW 
determination  lies  in  the  drizzle  category  for  which  only  a  20%  agreement  was 
reached.  Snow,  on  the  other  hand,  yielded  a  69%  agreement  while  rain  was  at  64%. 

Before  combining  the  separate  elements  for  general  discussion,  reference  to 
the  R/L  element  reveals  that  AUTO  observed  drizzle  (1.)  frequently  when  the  KAA 
observed  rain  (R).  The  drizzle-rain  discrimination  in  AUTO  was  based  on 
empirical  evidence  that  indicated  similar  responses  by  the  KSM  and  the  TRANS  in 
drizzle  and  dissimilar  responses  in  rain.  Thus,  this  discrepancy  can  be  due  to 
one  of  two  factors,  an  error  in  the  AUTO  relationship  just  described  or  a  bias  on 
the  part  of  the  KAA  observer,  in  which  certain  drizzle  events  were  improperly 
specified  as  rain  events. 

On  the  other  hand,  reference  to  the  total  KAA  drizzle  observations  (147)  and 
the  L/L  and  1,/OSTN  TO  VISN  elements  shows  that  the  tipping  bucket  (0.  005  in.  ) 
rain  gage  was  long  delayed  or  did  not  respond  at  all  in  many  of  the  drizzle  occur¬ 
rences.  in  spite  of  the  latter  discrepancy,  the  net  result  was  a  greater  frequency 
of  drizzle  observations  by  AUTO  (182)  than  by  the  KAA  (147). 

In  order  to  facilitate  further  discussion  of  the  contingency  matrix,  the  individual 
elements  were  consolidated  into  similar  but  fewer  categories,  see  Figure  12.  The 
categories  contain  groups  which  represent  frozen  precipitation,  liquid  precipitation, 
obstructions  to  vision,  no  weather,  and  no  observation.  If  these  categories  alone 
were  acceptable  as  an  observing  system,  then  AUTO  would  have  a  verification  of 
87%. 

Category  B  represents  the  cases  when  frozen  precipitation  was  observed  by 
the  KAA  and  not  bv  AUTO  and  vice  versa.  In  the  first  case  the  three  AUTO  ob¬ 
servations  of  liquid  precipitation  wore  due  to  a  malfunctioning  VIDE  and  the  re¬ 
sultant  failure  of  the  VIDE-KSM  relationships  to  correctly  discriminate  snow.  In 
view  of  the  high  success  rate  (S/S)  shown  in  Figure  11  (98  out  of  a  possible  145 
snow  observations),  this  represents  a  small  error.  In  the  second  ease  of  Category 
B,  the  nine  observations  were  divided  almost  equally  between  incorrectly  observed 
snow  and  freezing  rain.  Evidently,  refinement  is  required  on  the  frozen  precipita¬ 
tion  algorithm  since  AUTO  observed  more  than  actually  occurred.  Spatial  separa¬ 
tion  of  observing  points  should  not  be  too  important  in  this  category,  but  the  height 
of  the  observation  points  may  be.  At  Otis  A  KB  the  KAA  observers  are  located  in 
the  control  tower  at  a  height  of  96  ft  while  the  AUTO  surface  instruments  are 
located  about  6  ft  above  the  ground.  The  C  category  contains  two  elements,  the 
first  of  which  (S,  R,  1,/OSTN  TO  VISN)  consists  of  KAA  observations  of  PW  and 
I'W  and  1)V,  and  AUTO  observations  of  obstructions  to  vision  (OV)  only.  Examination 


of  the  records  showed  that  AUTO  failed  to  observe  a  present  weather  element  when 
the  1'AA  did  for  a  variety  of  reasons.  The  first  of  these  is  due  to  the  spatial 
separation  of  the  stations.  Precipitation  started  and  ended  at  significantly  different 
times  on  many  occasions.  The  next  reason  involves  the  rain  gage  used  by  AUTO. 
Precipitation  might  start  at  the  same  time  at  both  stations  but  the  tipping-bucket 
rain  gage  would  have  a  time  lag  in  reporting  this  precipitation  until  the  first 
0.  005  in.  of  rain  was  collected.  The  third  reason,  also  due  to  the  rain  gage,  would 
result  in  no  precipitation  being  reported  if  the  total  rainfall  was  less  than  0.  005 
inches.  AUTO  did,  however,  record  an  obstruction  to  vision  because  the  visibility 
observed  was  less  than  seven  miles. 
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Figure  12.  Simplification  of  Figure  11  Through 
Categorization 


in  the  second  C  category,  OSTN  TO  VISN/ZR,  ....  and  L,  only  58  cases 
occurred  when  the  FAA  observed  an  OV  while  the  AUTO  observed  a  PW.  Station 
separation  also  plays  a  major  role  here  with  a  secondary  contribution  from  the 


30 


algorithm,  which  terminates  precipitation  quickly  following  the  tip  if  visibility 
improves  above  seven  miles.  If  the  visibility  remains  low,  however,  AliTO  will 
continue  to  indicate  precipitation  for  a  60-min  period. 

The  observations  in  categories  D  and  F  in  Figure  12  are  identical  to  those 
found  in  the  same  categories  of  Figure  10.  The  sums  of  observations  in  both  fig¬ 
ures  are  equal,  although  the  individual  terms  differ  because  of  the  verification 
procedures  dealing  with  combined  observations  of  weather  and  obstruction  to  vision. 
The  discrepancies  in  the  D  category.  Figure  12,  can  be  ascribed  to  various  causes. 
The  inability  of  the  tipping-bucket  rain  gage  to  respond  rapidly  to  light  precipitation 
is  a  primary  factor.  Another  factor  which  became  apparent  upon  reexamination  of 
the  data  was  station  separation  which  resulted  in  different  beginning  and  ending 
times  of  precipitation.  A  final  factor,  previously  noted,  was  the  AUTO  algorithm 
which  attempted  to  determine  the  ending  time  of  precipitation.  The  reasons  for  the 
differences  in  Category  F  are  the  same  as  cited  in  the  previous  section,  that  is, 
station  separation  and  the  disagreement  between  FAA  and  AUTO  visibility  observa¬ 
tions  near  the  seven-mile  range.  The  F  category  in  Figure  12  is  exactly  the  same 
as  in  Figure  10  and  represents  the  non-operating  periods  for  both  observational 
systems,  FAA  and  AUTO,  during  the  14-month  study. 

6.  SUMMARY  AND  CONCLUSIONS 

A  study  was  performed  to  determine  the  feasibility  of  objectively  and  auto¬ 
matically  determining  two  key  components  of  an  aviation  weather  observation; 
obstructions  to  vision  and  present  weather.  The  automatic  system  utilized  was  the 
AFUL  Weather  Test  Facility  located  at  Otis  AFIi,  Massachusetts.  W  ithin  its 
framework  a  MAWS  type  automated  weather  system  was  selected  to  consist  of  an 
instrumented  tower  and  a  surface  complex  of  sensors.  The  objective  method  con¬ 
sisted  of  a  decision-tree  program  based  on  several  uniquely  different  responses 
by  these  weather  sensors  to  the  same  weather  phenomena,  and  on  discrimination 
techniques  using  tower  and  surface  instruments. 

The  characteristics  and  techniques  were  demonstrated  through  selected  hourly 
periods  of  observations  taken  at  1-min  frequencies  by  the  computerized  decision- 
tree  programs  called  AUTO.  The  ability  of  the  automatic  system  to  monitor  rapidly- 
changing  weather  events  was  clearly  shown  in  the  rases  of  rain  intensity.  In  fact, 
it  far  surpasses  the  human  observer  in  this  ability.  Sequences  were  also  presented 
which  typified  the  ability  of  AUTO  to  select  haze,  fog  and  haze,  ground  fog,  and  snow. 

Fourteen  months  of  hourly  weather  observations  taken  by  the  FAA  and  AL  TO 
were  compared  to  determine  the  effectiveness  of  the  automatic  system.  The  re¬ 
sults  show  that  the  AUTO  duplicated  the  FAA  observations  of  obstructions  to  vision 
and  present  weather  in  82%  and  86%  of  the  cases. 


Major  areas  of  agreement  in  the  test  involving  obstruction  to  vision  were  in 
the  discrimination  of  fog,  haze,  no  obstruction,  and  combinations  of  fog  and  haze. 
Ground  fog  was  correctly  identified  by  AUTO  in  7 5''i,  of  the  FAA-observed  cases. 

A l  TO,  however,  generated  considerably  more  observations  of  ground  fog  than  did 
the  FAA.  While  the  ground  fog  algorithm  used  in  AUTO  may  need  to  be  refined 
somewhat,  this  difference  may  also  be  due  to  height  differences  between  the  FAA 
and  AUTO  observation  points. 

The  areas  of  major  disagreement  in  the  test  involving  obstructions  to  vision 
can  be  attributed  mainly  to  two  factors.  The  first  factor,  as  pointed  out  in  Section 
5.  1,  is  based  on  the  regulation  which  requires  that  an  obstruction  be  reported  when 
the  prevailing  visibility  is  less  than  seven  miles.  For  example,  if  the  FAA  observer 
were  to  report  a  visibility  of  six  miles,  he  would  be  required  to  report  an  obstruc¬ 
tion  to  vision.  However,  if  the  AUTO  observation  were  seven  miles,  in  very  close 
agreement  with  the  FAA  observation,  no  obstruction  would  be  reported.  Thus,  the 
test  to  compare  the  AUTO  obstruction  to  visibility  observation  with  that  of  the  FAA 
also  became  a  test  of  how  well  the  AUTO  determined  prevailing  visibility.  The 
second  cause  of  discrepancies  was  the  distance  between  the  FAA  and  AUTO  observa¬ 
tion  points.  This  distance  was  most  significant  in  accounting  for  the  differences 
in  time  of  onset  and  clearance  of  fog. 

Major  areas  of  agreement  in  the  present  weather  test  were  found  in  the  dis¬ 
crimination  of  snow  and  rain.  The  V1DF-FSM  algorithm  for  snow  determination 
worked  extremely  well,  and  both  instruments  performed  reliably  and  accurately. 

The  algorithm  for  rain  determination  was  also  very  reliable. 

The  major  problem  areas  for  the  weather  determination  program  were  related 
to  short  sampling  period  and  instrumental  problems.  The  fourteen  months  of 
record  yielded  a  very  low  frequency  of  most  weather  events  and  the  almost  total 
lack  of  freezing  rain  and  drizzle.  The  instrumental  problem  in  the  weather  pro¬ 
gram  involved  the  key  instrument,  a  tipping-bucket  rain  gage,  liven  though  the 
instrument  was  designed  to  record  very  light  precipitation  amounts,  0.  005  in.  ,  its 
inability  to  determine  precisely  the  beginning  and  ending  of  precipitation  caused 
many  observational  discrepancies.  A  contributing  factor  to  these  discrepancies 
was  the  separation  between  observation  points. 

In  conclusion,  it  has  been  demonstrated  that  data  from  a  selected  array  of 
automated  weather  sensors  can  be  used  in  conjunction  with  a  decision-tree  com¬ 
puter  program  to  identify  a  wide  variety  of  weather  and  visibility  restriction 
elements.  Thus,  the  acquisition  of  real  weather  for  an  aviation  weather  observa¬ 
tion,  a  duty  presently  performed  by  the  human  observer,  is  obtainable  through  the 
addition  of  a  small  group  of  instruments  to  the  Modjlur  Automated  Weather 
System.  The  inclusion  of  an  objective  method  of  this  type  in  a  software  system 
designed  for  the  Automated  Weather  Distribution  System  (AW  DS)  should  be  given 
serious  consideration. 
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